THE CLOSED ORBIT CONTROLLABILITY CRITERIUM 



Valeri Marenitch 



Preliminary version. Comments are welcome. 

Abstract. We prove that every closed "general" trajectory of the control system Em has an open neighborhood 
on which Em is controllable if 1) this orbit contains some point where the Lie algebra rank condition (LARC) is 
satisfied, and 2) the set of control vectors is "involved" at q. In particular, for the control systems Em on the compact 
connected manifold M n with an open control set this gives the following "Closed Orbit Controllability Criterium": 
The dynamical system Sjf of the considered type is controllable on M n if and only if for an arbitrary point q of 
M n there exists a closed trajectory of the control system going through this point. Wc also present examples which 
show that our conditions are necessary. 



Introduction and results 
In this note we study the chronological map Q(t%, ...,ti\r) : R — > M n of the control dynamical system 

q(t) = V u (q(t)) (Sm) 

on a complete manifold M n . We prove that it is an open map in the open domain in R N for sufficiently big TV, 
if the system satisfies the well-known Lie Algebra Rank condition (LARC) . This implies the controllability of 
the system in some neighborhood of any, so called "general" closed orbit. 

To ensure that an arbitrary trajectory of the system can be approximated by some general trajectory we 
use the "involvement" condition which, essentially, means that any direction V u lies in some positive cone 
generated by some set of V Ui satisfying LARC. More precisely, we prove that if the set of control vectors V u 
is open in the linear subspace L which it generates (the "open" condition), and its convex hull coincides with 
L (the "ample" condition), then Ejvf is "involved", see definitions below. 

For the control dynamical systems Y>m on a compact connected manifold M n which 

1) satisfy the Lie algebra rank condition everywhere and 

2) have "involved" control vectors set; 

we prove the following " Closed Orbit Controllability Criterium" : such system is controllable if and only if 
through every point of the manifold goes some closed orbit of S^, see Theorem A below. 

One of the applications of the Theorem A is to bilinear systems in the Euclidean space. These are the 
systems of linear equations 

x(t) = A(u)x(t) = (A + u 1 B 1 + ... + u d B d )x(t), (£) 
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where the right-hand side - the linear operator A{u) - is a linear combination of some constant linear operators 
A and Bk which do not depend on the control parameter u E R d . For such systems the "Closed Orbit 
Controllability Criterium" provides many new conditions for controllability, both necessary and sufficient; see 
our forthcoming paper [CM]. Here we mention only the simplest one for the systems in three-dimensional 
Euclidean space i? 3 , see Theorem B below: if for two control parameters u and v the right-hand side linear 
operators have complex eigenvalues Xc(u) and Xc(v) correspondingly, then the system E satisfying LARC is 
controllable if for the real eigenvalues Xr(u) and Xr(v) of A(u) and A(v) it holds 

(Ajj(u) - Re(X c {u))) {X R (v) - Re{X c {v))) < 0. 

The results of this paper were obtained during a visit to the Universidad Michoacana (Morelia, Mexico). 
The author sincerely thanks Prof A. Choque for the organization of this visit, cooperation and hospitality. 

f. Twisted LARC 

To introduce notations we remind some basics of the theory of control systems, see [AS] . 
Let M n be a complete n-dimensional manifold without boundary. The control system on M is given by 
the family of dynamical systems 

(1) «(*) = K(«(*)), qeM,ueU- (S M ), 

where the right-hand side is a smooth vector field V u depending on the control parameter u from some set U 
of controls (usually the domain in some Euclidean space: U C R d ). The solution of Em is the trajectory q(t) 
such that 

(2) q(t) = V u{t) (q(t)), q G M, u(t) : R -> U 

for some admissible control function u(t) (usually, the locally integrable functions u(t) : R — > U C R d ). 

1.1. Semi-group Q + of Em- 

For a given u G U denote by P* the one-parameter group of diffcomorphisms of M generated by the vector 
field V u on M. The standard notations are: 

t 

(3) P l u = P^ u = exp( J V u dr) = e tv " , 

o 

where t might be positive, negative or zero (and then P° is the identity map Id). Compositions of such 
diffcomorphisms for different vector fields V Ui , called " chronological products" , 

(4) g(t 1 ,t 2 ,...,t N ) = Pl\o...op^ N 

generate the Group Q = £(Em) of the system, which is the (Frechet-) subgroup of the complete group 
Diff(M) of all diffeomorphisms of M. If we restrict ourself only to nonnegative parameters U we have the 
(positive) semigroup Q + of the system. If we assume that every control function u(t) can be approximated 
by a piece-wise constant function uj^{t) which equals Ui on the interval (7i_i,Ti) where Ti = tfq + ... + tf, 
and that every trajectory of the control system Em can be approximated by trajectories with the piece-wise 
controls; then the set + (q) of points reachable from q by trajectories of Em equals the orbit G + (q) of q under 
the action of the semigroup Q + . 
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The system Em is controllable if for every two points q,p there exists some trajectory q(t, u(t)), < t < T 
of the system Sm starting at q — q(0,u(0)) and ending at p = q(T,u(T)). In other words, the system is 
controllable if the action of the semi-group Q + is transitive. Since it is easier to handle the group-actions 
than actions of semi-groups, the question of whether Em is controllable or not is, usually, divided into two 
sub-questions: 

1) whether the action of the group Q is transitive or not, 

2) whether the orbits of the semi-group Q + actually coincide with the orbits of the bigger Q. 
Although in general the first question is not easy, its local version though has the following well-known 

answer. We may call the system Em locally transitive at p if there exists some open e(q)-neighborhood 
Bit(q) such that every point p from this neighborhood if reachable from q by some trajectory q(t, u(t)), < 
t < t{q 1 e(<z)) of the ^-action, where t(q, e(q)) — > as e(q) — > 0. Then the local transitivity in q is assured by 
the well-known Lie algebra rank condition (LARC) 1 : 

1') LARC{q) The Lie-algebra LA generated by some number of vector fields V Ui ,i = 1, ...,d' is such that 
its evaluation at the point q coincide with the whole tangent space T q M to M at q. 

Indeed, note that in general the one-parameter diffeomorphisms in the "chronological product" do not 
commute. Thus, it is possible to move the point by the action of Q not only along vector fields V Ui for different 
i, but also along their commutators, see the (11) below; and so on. Therefore, the orbit Q(q) - by The Orbit 
Theorem, see [AS] - is some immersed submanifold in M n with the space of tangent vector fields closed under 
the Lie bracket. Then from the LARC at q we see that the tangent space of the orbit Q{q) equals the tangent 
space to the whole M n , and that the orbit Q{q) contains some open neighborhood of q. The last means that 
the action of Q is locally transitive. 2 

In general, the point p close to q could be reached by "long" trajectories issuing from q so that the LARC(q) 
at q is not necessary for controllability or transitivity of the (/-action, see the example 5.3 in [AS]. Actually, 
slightly generalizing this example it is easy to construct controllable dynamical systems such that the LARC 
does not hold at any point at all, i.e., such that CA(q) ^ T q M n everywhere: say, for arbitrary n > 2 we may 
always have dim(CA(q)) < 2. 

Example 1. For an arbitrary n > 2 there exists a controllable dynamical system Ey on n-dimensional torus 
T n such that in all points dimLA(q) < 2. 

Construction. 

Indeed, take the product II™ C R n of the closed interval [0, n— 1] with (n— 1) -dimensional unit cube [0, l]" -1 , 
and introduce coordinates x = {x, y 2 , y 11 } in LI correspondingly. Choose some smooth nonnegative function 
uj(r) with support inside [1/3, 2/3] and an integral bigger than 1, and define the vector field V(x, y 2 , y n , u) 



x such systems are also called completely nonholonomic or bracket-generating 

2 Of course, the actual choice of "generators" V Ui ,i = l,...,m for systems Ej^f which satisfy LARC is not canonical, but 
depends on the particular form of V u . For instance, when the vector field V u depends smoothly on u we have 

V u = V uo + dV UQ (u - u ) + o(\\u - M ||) = A+ (u - u )'Bi + o(\\u - u \\) 

for A(q) = Vu (<?) and Bi (q) = dV u (p) / du 1 at every urj . Then for the smooth system satisfying LARC we may find uq S U, U C R d 
such that the Lie-algebra generated by the vector fields A and Bi for Ui = uo + SEi for all sufficiently small 5, where Ei is the 
unit basis vector in R d with number i; coincide with the Lie-algebra generated by vector fields A and Bi at Mo. Then, without 
loss of generality we may assume, that the "generators" above are the vector fields A,Bi. We may reformulate this by saying 
that under the LARC the tangent space T q M n to M n at the point q is generated by vectors A(q), Bi(q) and their commutators: 
say Cij(q) = [Bi, Bj](q), and so on. This happens in the particular case of so called bilinear systems in Euclidean spaces when 
M n =R n : 

q(t) = (A + u 1 B 1 + ... + u d B d )q(t), 



which we consider in [CM]. 
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in the parallelepiped II as follows: for k < x < k + 1 where k = 0,1, ...,n — 2 is integer take 
(exm 1) V(x,y 2 ,...,y n ,u) = — + uuj{x - k) +2 , 

where the control u belongs to an open interval = ( — 1,1). Since V is invariant under parallel translations 
of R n of the form: 

V(x, y 2 , y n , u) = V(x, y 2 , ...y k + 1, y n , u) 

and 

V(x,y 2 , ...y k , ...,y n ,u) = V(x + d,y 2 , ...y k , ...,y n ,u); 

- in fact, it depends only on x - we see that after identification of opposite sides of the parallelepiped II 
we obtain the n-dimensional torus T n with a smooth vector field which we denote again by V{lt,u). All 
trajectories of V{~x?,u) arc curves normal to the sub-torus T n_1 defined by x = with {y 2 ,...,y n } being 
local coordinates in T™ _1 . From the definition above we see that changing the control u(t) on the interval 
t £ [k — 1, k], k = 0, n — 2 leads to the change of the y fe+2 -coordinate, leaving all other coordinates intact. 
Thus, the point p with arbitrary coordinates {y 2 , ■■■ 1 y n } can be reached from the zero-point q (possibly, after 
one additional "rotation" with zero control along x-coordinate parallel of the torus T n ) with the help of the 
following piece- wise constant control function u(t): 

(exm 2) u{t) = y k ( J w(r)rfr)- 1 

on the interval k — 1 < t < k. We see that + {p) = T n , and the control system 
(exm 3) ^ = V(l?,u) (S T ) 

is controllable, while the dimension of CA in each point is 1 or 2. 



Despite the example above, the controllability implies some generalized iLARC ("integral"). We address 
this question later, while here we note only the following: if the action of Q is transitive then the orbit of 
every point under this action is the whole manifold M n , i.e., is an open subset in particular. We know that 
every orbit is an immersed manifold. Therefore, since M n is a second category set; it has to have the same 
dimension n as M n . Then compositions (4) ("chronological products") with some fixed N should provide us 
with an open map (surjection) from the space of (ii, ...,ijv) to some neighborhood of q in M n . The standard 
arguments then show that controllability leads to some kind of generalized LARC along all closed trajectories 
through q compared with the help of corresponding Poincare maps. 

In this paper we restrict ourself to the case when the LARC holds at the point q we consider: 
(5) CA(q)=T q M n , 

and then prove that every " general" closed orbit through q belongs to the orbit Q + (q) together with some its 
open neighborhood 23+ , and further, has some open neighborhood B q on which the system Sm is controllable. 
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1.2. Vector fields as operators on C°°(M) (after [AS]). 

We know that the manifold M n may be identified with homomorphisms <j> : C°° (M) — > R of the algebra 
of smooth function on M; i.e., for each algebra homomorphism cf) there exists some point q G M such that <fi 
coincides with the evaluation homomorphism q(a) — a(q) at this point, see [AS]. 3 

In the same way it is useful to represent diffeomorphisms P : M — > M as automorphisms of the algebra 
C°°(M) of smooth functions on M acting by change of variables: for any given function a on M the action 
P on a is given by P(a) = a o P. Indeed, every algebra homomorphism A : C°°(M) — > C°°(M) is some P 
defined by P(q) — qi where q\ = q o A. 

Then the vector field V is given by the derivation of C°°(M), i.e., the linear operator V : C°°(M) ->• C°°(M) 
satisfying the Leibniz rule V(ab) = V(a)b + aV(b). If the vector field V generates the flow P* then from the 
definition it follows 

(6) = VoP t = P t oV. 

If P* denote the differential of P then the vector field P*(V) equals the derivation P _1 o V o P. This justifies 
the notation P* = Ad(P), while the calculation 

(7) ^{AdP t )W\ t=0 - |(P 4 o W o p-*)| t=0 = W, W] 

shows that the Lie bracket of vector fields V and W is given by the derivative of Ad(P t ) at t = which is 
denoted by (adV)W — [V,W]. Since the Lie bracket is preserved under the P* we conclude AdP f [X, Y] = 
[AdP t X, AdP t Y] which after differentiation at t = gives the Jacobi identity 

(adV)[X,Y]} = l(adV)X,Y] + [X, (adV)Y] = [V, [X,Y]] = [\V,X],Y] + [X, [V,Y]}. 

From (6) we may conclude the following asymptotic form for P*, also denoted as 

00 j-n 

(8) exp(tV) = J2-V n , 

n=0 

where V n = V o ... o V (one variable conjugate Taylor formula). If 

m— 1 ^ ^ 

(9) S m (t) = Id+Y, J- J V Tn o...oV Tl dT n ...dr 1 



n=l 



A„(t) 

is the partial sum, then for any a G C°°(M), s > and compact K C M it holds 

t 

(10) IKezp y Frdr - 5 m (t))a|| Siif < 0(t m ), 

o 

see (2.13) from [AS]. Below we assume that m is big enough, say m > 2"; which is sufficient for estimates below. 
Using (9-10) for diffeomorphisms generated by different vector fields we deduce the asymptotic representation 
for an arbitrary chronological product (the conjugate Taylor formula for many variables), or approximation 



3 Notc that in the proof of this (Gelfand-Ncimark type) theorem in the Lemma Al in [AS] the set M\K can be empty. 
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formula for the action of the group Q. For instance, for the curve q(t) = q o P* o P^ o P v * o P w t it gives the 
following expansion: 

(11) q(t) = q o (Id + t 2 (V o W - W o V) + o(t 2 )), 

where V, W are generators of the one-parameter groups of diffcomorphisms Pi and P^ . Generally, for the 
chronological product Q(t\, tjy) = P^\ o ... o P^« the same arguments give: 

m— 1 , n m— 1 , n 

(12) g( tl) t N ) = go = q o (Id + ]T ^ ) o ... o (Id + ]T ) + 0(7™), 

At. At. 

n— 1 n— 1 

where by T we denote |ti| + ... + |tjv | - We may further expand (open all brackets) the above formula (12) to 
obtain the Taylor type approximation: 

k=m— 1 a'l a k N 

(13) q( tl ,...,t N )=qo(Id+ ]T ^^C°-°0 + 0(n 

where a k — (a\, ...,a k N ) is iV-multi-index of order k; i.e., ||a fe || = a\ + ... + = k; while V"* = V Ui o ...V Ui ) 
denotes the composition of on derivations V Ui . For the notational convenience, we consider the vector fields 
V Ui for i = 1, N to be different, also they may be (and usually are) taken from some finite set Vi,i = 1, dl 
of vector fields (say, satisfying the LARC). It is also important that, despite the fact that the asymptotic 
representations of chronological products above in general may be not convergent for some collections of vector 
fields V u and on some functions from C°°(M n ), in our case - when the set of generators V Ui is finite and we 
consider the action on coordinate functions - representation above are convergent (and are, actually, nothing 
more than the Taylor formulas). 4 

1.3. Rank of the chronological map. 

Due to (6) for the given chronological product q(t\, ...,ijv) its partial derivatives are: 

(14) ^«(ti, ...,t N ) = A P *i o ... o P*« = P^ o ... o V Ui o P<* o ... o P%, 
which with the help of (9,10) leads to the following asymptotic representations: 

Q n m— 1 n m—1 n m-1 n 

(15) — q fr,...,t N ) = W qo(Id+Y, ^V: i )...oV Ui o(Id+ £ -L ..o(Jd+ ^CJ + 0(T™), 

1 1 n=\ ' n=l ' n=l 

or, comparing with (13) we get: 

~ k—m—l p. ,a*l ,ct N 

as) -^,...,^ = ,o E E^S^ 10 - ^ + ° (Tro_1) - 

Again, we remind that the chronological map Q : (fi,...,tjv) — ► <z(ti, tjv) G M" we understand here 
as the map from the Euclidean space R N to algebra homomorphisms of C°°(M), i.e., each point of M 

4 In fact, we may use these finite approximations for the chronological products as their substitutes to obtain all our results 
below and the Theorem A in particular. The estimate (10) then guarantee that the claim of the Theorem A is valid for the 
asymptotic limit under our conditions - openness of V(q) - on the set of control vectors. 



THE CLOSED ORBIT CONTROLLABILITY CRITERIUM 



7 



is understood as the evaluation homomorphism. Then partial derivatives of q(t) above are derivations of 
C°°(M") corresponding to the vector fields. In a "usual sense" - as sections of the tangent bundle of M n - 
these partial derivatives are 

(17) wMh, ...,t N )) = dg(h, ..., tN )(-^), 

where here the chronological map Q is the smooth map from the Euclidean space R N to the differential 
manifold M" 

Now we introduce some local coordinates (x 1 , ...,x n ) in some small neighborhood which contains both 
points q' = q(ti, ...,ijv) and q - assuming of course that they are close enough; i.e., that \T\ is small. In this 
neighborhood we have coordinate functions x J : M n — > R, which we may assume to be continued outside the 
coordinate neighborhood in an arbitrary way; i.e., it holds: x' J e C°°(M n ). The corresponding coordinate 
vector fields are such that 

(18) Eitf) = S{ 

in this coordinate neighborhood. Then for an arbitrary differential operator D a of order \a\ strictly bigger 
than one - not having order zero and one terms - it holds 

(19) D a (x j ) = 0. 

Each vector W tangent to M" at the point q 1 = q{t\, ■■■,t N ) is defined by its action on coordinate functions 
as follows: 



(20) w^j2^ w ^y^- 

i=l 

Rewrite (16) separating differential operators by their orders: 

q m — 1 

(21) w q{tx, t N )=qo{Y J d k ia {tu t N )D k a (V Ul ,..., V UN )) + O^ 1 ), 



where d k a are some polynomials of t,, and D 1 ^ - some finite number of differential operators of order k, i.e., 
such that in our coordinate system 

(22) D k a = c k a J Xl ,...,x n ) 



d Sr x r ' 



where c k s (xi, x n ) - some smooth functions, and s r — (si, s n ) some multi- index of order k - Si + ... + s n 
k. Due to (19) it holds 



(23) ..., tN ){x!) = dl(h, ...,t N )Di( Xj ) + 0(T m ^). 



In other words, we see that the differential of the chronological map can be recovered from its action on linear 
coordinate functions, while this action is determined by its "first order operator part". More precisely, the 
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differential dQ{t\, t^) of the chronological map at the point q on the vector -J^- equals the derivation - the 
vector field we denote Fi(t\, ...,£at), which action on the coordinate function x j is given by: 



(24) Fi(ti, t N )(x 3 ) = (dg(t u ...,t N )( — )y = —q(t u ...,t N )(x 3 )^dl(t 1 ,...,t N )D 1 a (x J ) + 0(T m - 1 ). 



Examine Fi more closely. From (16) we conclude: 

(25) F i (t 1 ,...,t N ))= ]T Y.W.tWTlh^ 1 ^ --- ^"^ ^ 1 ^ 

where by D\ = D 1 (I^f i 1 o ... o V" N ) we denote the first differential operator part of the compositions of 
derivations V Ui ; which by direct calculations equals 

(26) Dl =D\V£ 0...0VZ) = (v s UK..v< d J^ dxSai (v s l..(v s £ )...)-£-, 
where vf are coordinates of the vector field V Ui : 

< 27 » 

Comparing (24) with (25) we see that polynomial coefficients of first order differential operators D\ (which 
(operators) do not depend on (ti, £jv)) are the? following monomials: 

k k 

(28) d\ a {t 1 ,...,t N ) = ^{±f^). 

For what follows it is important that such monomials are linearly independent; i.e., if some linear combination 
Y] K a d\„{t\, ...,tj^) is identically zero, then all coefficients A a are zeroes. 5 If some D\(x 3 ) 7^ in this linear 

a 

combination, then the zero set of the action on x J of the first order differential part of the differential of the 
chronological map at the point q on the vector J^- vanishes on the zero set given by the polynomial equation: 

(29) Q{ = {(t 1 ,...,t N )\^dl(t u ...,t N )D 1 a (xi) =0}. 

a 

As the corollary we conclude the following. 
Lemma 1. The zero set flj C R N given by the polynomial equation is closed and has an empty interior. 

Next we note that due to our asymptotic expansions (23), (24) for sufficiently small |T| the differential 
of the chronological product Q(t\, ...,fjv) : q — > <?(ii, —,ijv) is not a surjection on R N at some point q'(t') 
for t' = (t[, t' N ) if for some system of coordinates of the type we consider, the action of all D x a on some 
particular function x 3 vanish at zero; i.e., such that 

(30) qoD 1 a {x j ) = 0. 



5 To prove that in such combination A a = take the partial derivative d a /dt" 1 ... of this linear combination at zero. 
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Indeed, if the differential of Q is not surjection we may construct (using the Orbit theorem) the coordinate 
system a^',1, ...,n in some neighborhood of q such that the first n' < n coordinate vectors E i} i = 1, ...,n" at 
the point q' = q(t[, t' N ) generate the image of the differential of Q at the point q - some n" -dimensional 
subspace of T' q M n with n" < n. Then the derivatives of all x 3 , j > n" in all direction of this subspace vanish, 
i.e., (30) holds. If otherwise; i.e., we are given some chronological product Q{t\, ...,t/v) : R N — > M n such that 

(30) is not satisfied for an arbitrary coordinates x l , i — 1, n then this map is a surjection on the open subset 
R N \Q which complement fi has an empty interior, for \T\ < e for some small e. Since from (23) we see that 

(31) Q° D a( X j) = gjai Q %a% d -^ G{tl,---,t N )\ tl = ...= tN = {x 3 ), 

combining our arguments above we come to the following statement. 
Lemma 2 ("PD-LARC"). The chronological map 

(32) g {ui _ UN) (t 1 ,...,t N ) = Pi\o...oP t u - 

is a surjection for \T\ = \ti\ + ... + |ijv | < where e is sufficiently small, and for t — (ti, ...,ijv) G R N \£l where 
£1 closed set with an empty interior, given by some polynomial equation; if there exists n linearly independent 
partial derivatives 

(33) Di=D\ yJ> g(t u ...,t N ) ltl =...= tN = )(x j ), 

where D 1 denotes the first order differential part, and a(j) is some multi-index (a(j)i, a(j)jv). 

Note, that the Lemma 2 condition is not stronger than the LARC. If the LARC is not satisfied then, using 
the orbit theorem, we may always construct the coordinate system in M n , such that the orbit of q is contained 
in some coordinate subspace given by, say x n — 0. Then all partial derivatives of Q will have the first order 
differential parts with the vanishing action on x n . 

Now we are ready to construct the chronological maps as in the Lemma 2 above. Since any exponential 
Pi is the identity map when t = 0, the partial derivative of (32) in (33) equals the same partial derivative of 
the chronological product only of those P^ with a(j)i ^ 0. Therefore, our chronological product satisfying 
conditions of the Lemma 2 may be constructed as the superposition of the chronological products 

(34) g\t{, ...,ti {j) ) = Pj o ... o P*f > , v = (t{, ...,ti(j)) e R k ^\ 

which partial derivative has the first order differential part equals some Ej such that Ej , j = 1 , . . . , n are linearly 
independent. Now the LARC guarantees the existence of such Q j . 

Indeed, if Em satisfies the LARC we may assume that the basis Ej,j = 1, .., n consists of some number of 
vectors V Ui , i = 1 , . . . , d! - which we denote by Wi , i = 1 , . . , d' and their mutual commutators Wi , i = d! + 1 , . . . , n, 
where 

(35) W i = [Wp i ,[W f)i _ i , [...]]]; i = d' + l,...,n 

for some k- multi-index [3 l = (!3 l k , ...,/3{), where the order of the commutator k in turn depends on the index i 
of the vector Wf. i.e., k = k(i). Easy to see that orders of commutators are bounded by n - the dimension of 

M" 6 



5 Hcncc m > 2 n is sufficient. 
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By definition (35) the derivation Wi is the linear combination of the derivations which are the first order 
differential parts 

(36) Wi = Y,{-^YD\W pm o W pUk _ ir .) 
of differential operators of the form 

(37) ^ (fe) o^_ i)0 ...o^ (i) , 

where o some permutations of indexes /3j. An arbitrary derivation in the linear combination (36) is the partial 
derivative of the chronological product of the type: 

gk 

(38) w, m o WfU _ i} o ... o w 0Ui) = — r # (tl) t k) = p;i ik) o p;r i5 ... „ ^ w . 

Taking composition of such products for all i = l,...,n with different arguments t s we obtain (very long!) 
chronological products whose partial derivatives realize all monomials in (36). We call such chronological 
product the general at q relative to the set of generators {Vi, Vv}. They satisfy the Lemma 2, which 
may be reformulated as follows. 

Lemma 3. //Em satisfies the LARC at q then there exist the general chronological product Q : R N — > M n 
at q, such that its differential is a surjection on R N \£l for some closed ft C R N with an empty interior which 
is given by some polynomial equation. 

Definition. The trajectory q(t),0 < t < c of the control system Em is called the general relative to 
the set of generators {Vi,...,V/<} if it contains some interval which goes from q = q(0) to some point 
q(e) — Q{t\, t N ){q) with all ti positive and such that t = [t\, ■■■ 1 t N ) e R N \Q. 

If q{t),0 < t < e is the general trajectory relative to some set of generators of Em then by definition 
some general chronological product Q provides the surjection from some neighborhood of zero in R N over 
some neighborhood B{t) of q(e), which means that all points from this neighborhood are reachable from 
q, or B(e) C + (q). If further, this interval q(t),0 < t < e is a part of some closed trajectory q(t), < 
t < t q going through the point q = q(t q ) again under some control u(t) : [0,t q ] — > U then by the standard 
continuous dependence arguments the image of this open neighborhood B(e) under the flow Fftjuit)) is the 
open neighborhood of q(t), e < t also reachable from q. The union of all these neighborhoods gives us the open 
neighborhood B q of the closed trajectory q(t), <t<t q , which by construction belongs to the positive orbit 
ofq: B+cO+(q). 

We formulate the obtained results as follows. 

Theorem 1. // the control dynamical system Y,m satisfies the LARC at the point q; i.e., there exists the 
complete system - the set of generators - Ej,j = l,..,n',n' > n (Ej generate T q M n ) of T q M n consisting of 
some number of vectors V Ui ,i = l,...,d', denoted by Wi,i = l,..,d'; and their mutual commutators Wi,i — 
d' + l,...,n' 

W i = [W 0l ,[W^_ i ,[...}]};i = d' + l,...,n', 

then the set of points q{t\, ...,tjv) (where all ti are positive) reachable from q by general trajectories relative to 
this set of generators is an open subset of M" . If there exists a closed trajectory q(t),0 <t <t q going through 
the point q then some open neighborhood B+ of this trajectory is reachable from q: 



q'EO + {q) for all q' G B q . 
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Now consider the negative orbit 0~(q) of q - the chronological products G(t\, ...,tjv) where all U are non- 
positive. By the definition these are the points from which we may reach the point q by chronological products 
- trajectories of Em with piece-wise constant controls; i.e., q' G 0~(q) if and only if q G + {q'). Therefore, 
applying our Lemma 3 above we see that if some general trajectory goes into the point q; i.e., there exists the 
trajectory q(t), ~e < t < 0, q(0) = q of Em containing two points also connected by some general chronological 
product with negative arguments; then the following counterpart of the above theorem is true. 

Theorem 2. If the control dynamical system Em satisfies the LARC at the point q; i.e., there exists the 
complete system - the set of generators - Ej,j = l,..,n',n' > n (Ej generate T q M n ) of T q M n consisting of 
some number of vectors V Ui ,i = l,...,d', denoted by Wi,i = l,..,d'; and their mutual commutators Wi,i — 
d' + l,...,n' 

W i = [W /3i ,[Wp Li ,[...]}]-,i = d' + l,...,n', 

then the set of points q{t\, ...,t N ) (where all ti are negative) from which we can reach q by general trajectories 
relative to this set of generators is an open subset of M n . If there exists a closed trajectory q(t),0 < t < t q 
going through the point q then from some open neighborhood B q of this trajectory we can reach q; 

qeO+(q r ) for all q G B~ . 



2. General trajectories and the involvement condition 

Our definition of the general trajectory depends on the set of generators V Ui ,i — l,...,d'. The same 
trajectory may be general relative to the one set of generators and not - relative to another set. 

Definition. We say that the system Em satisfying the LARC at some point q is involved if for an arbitrary 
trajectory q{t) going through this point there exists some set of generators {V Ui ,i = 1,...,/'} such that the 
trajectory q{t) is general relative to this set. 

In general, the verification of the "involvement" condition is complicated and may require the solution of 
the classification problem for vector fields on M n 7 Here we single out the case when the answer is easy. 

Denote by V(q) the set of all control vectors V(q, U) — {V u , u G U} at this point, and by L(q) the linear 
subspace in T q M n generated by V(q). By Con(q) we denote the convex hull of V(q). We may assume that 
the dimension (d') of L(q) is locally constant and the family of vector spaces L{q) itself is smooth and locally 
trivial - the union of all L(q') over the points q' from some small neighborhood B(q) of q - which we denote 
by Lb = {L(q')\q' G B(q)} - has a natural structure of the direct product B(q) x R d (is a locally trivial 
vector bundle). The set Lb is a subset of the restriction of the tangent bundle TM over B(q), and admits 
natural coordinates {(x 1 , ...,o; n , j/ 1 , ...,y n )} in which the vector y 3 (d/dx 3 )(x) tangent to M at the point with 
coordinates x = (x 1 ,...,x n ) has coordinates (x 1 , x n , y 1 , y n ). 8 

Definition. We say that the set of all control vectors V u ,u GM is open at q if the subset {V(q')\q' G B(q)} 
is an open subset of Lb- 9 

Let Vi,i — 1,...,N be some set of generators. Consider some family of linear transformations of C(q') : 
R N -4- R N for q' in a small neighborhood of q given in the basis {Vi,i = l,...,N} by a matrix C(q') = 
(Ci(q'));i,k = 1,...,N, and define the vector fields Vk = c l k Vi. Then, since V(q') is open, all vector fields 
Vk(q') belong to V(q') when {c\ (q')) close to the identity matrix; i.e., they are control vectors of our control 

7 Say, is the dependence V u on u "stable" in some sense or not? 

8 For d! ^ n the set Lb is not contained in any coordinate subset of the form yi = in any coordinates. 
9 which is stronger than simply to require: " V(q') is an open subset of L(q')" . 
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system Em- In particular, if C(g',r) is some continuous family of linear transformations defined in some 
neighborhood of q such that C(q, 0) = Id then for small r vector fields Vk(q', r) = c^(g', r)Vfc(g') belong to 
y(g'). We denote by Q{r){t\, ...,tjv) the corresponding chronological product defined with the help of these 
vector fields: 

(39) a(r)(* 1) ...,^) = p*; (r) o...oPg (T) . 

Now we prove that it is possible to move the set of generators in an arbitrary way inside open V(q), while 
keeping the equation (29) of the zero set stationary. In order to do so, we define derivatives Ui(r) of t^(r) in 
the next lemma; where for simplicity we consider the moment r = 0. The result, of course, is valid for all r 
sufficiently small. 

Lemma 4. For an arbitrary vectors Ui,i — 1,...,N in L(q) there exists a family of linear transformations 
C(q',r) in some small neighborhood of B(q) of q such that 

(40) 6(V i (r)/6r) lT=Q = U i , 
and for all i,\ai\ > 1 it holds 

(41) ffillM .o, 

OT | r =0 

where C(q', r) is given by the matrix (c!-(q', r)),i, k = 1, N, and Vi(q', r) = c^(q', r)Vfe(g'). 
Proof. Indeed, by a direct calculation we see that 

(42) ^t^ ^o = £ ( ^ S ° Ui ° 



s=0 



We find Cj(r) for each i separately as follows: for a given i find a coordinate system (xj, x") in a neighbor- 
hood of q such that the particular vector field Vi with a given i coincide with the first coordinate field d/dx\ 
of this system. In such coordinates the equation (42) takes the form: 



s— 

which obviously has the solution c^(q', r), say: 

(44) c 4 fc (g',r)=<5f +r(M) |T=0) 
and such that the products c-^ are constant on Xi coordinates: 

t)r k 

(45) {^)\r=M)W) = (U?vl)(q), 

where v^q') and are coordinates of Vk(q') and f/j(g) in the coordinate system (xj, ...,x"). To complete 
the proof it is sufficient to repeat our arguments for all i, define functions c\ in different coordinate systems 
(xj, xf), and then rewrite them all (i.e., change coordinates) in the same previously given initial coordinate 
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system (a; 1 , ...,x n ). Note, that (45) in particular defines all jets of the functions c\, and (43) holds for all a 
with \a\ arbitrarily big. 

The Lemma 4 defines the variation on r of the set of generators Vi (r) in such a way that the zero set 0, 
given by (26) for the chronological product (39) is defined by the first members of the approximation sum 
for Q(t): the action of the member d^D^ in the asymptotic sum for the differential dQ(r)(d / 'dU) on the 
coordinate function x 3 does not depend on r if \a\ > 1 due to (41) above; we have: 
(46) 

—dg(r)(d/dti)(x% =0 = —(J2d ia (h,...,t N )D 1 a (xi)) lT=0 = — ( £ d^fr, (^))| r=0 = U t {x 3 ). 

a |a|=l 

As we wrote before, the differential of the chronological product may be not a surjection at the point 
t = (ti, ...,fj\r) S if all partial derivatives dQ(r)(d/dti) at this point vanish on some smooth function on 
M", which, without loss of generality we may assume to be some coordinate function x 3 . In other words, 
the image of the differential is contained in the subspace of T q ^M n 7 which at this moment (r = 0) we may 
assume to be the tangent space to some coordinate submanifold in M n given by {x 3 = const}. At the origin 
t = - the point q - this image (of dQ{r)) always contains vectors Vi — V Ui ,i = 1, ...,N. Therefore, we may 
assume that our coordinate systems (x 1 , ...,x n ) are such that 

(47) W)(«) = 0, 

or, since the derivatives Ui of V^(r) at q also belong to V(q), that 

(48) Ui(x j )(q) = 0. 

Hence, if C(q',r) is defined with the help of the Lemma 4 for all < r < e and depends continuously on 
r we will have a continuous family of the sets of generators Vi(r) such that in the equation (29) defining the 
zero set f2(r) of the chronological product Q{t) has the same coefficients 

(49) Di(Vr (r) o ... o V£"( r )) = const 

for all a. Therefore, O(r) does not depend on r and is given in coordinates (t\, ...,tjv) by the same equation 
(29). Because of this for an arbitrary point t* from fi(r) we may find a curve i*(r),0 < r < e issuing from 
this point t*(0) = t* and outside f2(r) into the open domain R N of points with positive coordinates: 

(50) t*(r)>0 and t*(r)^n(r) for r > 0. 
Next we define derivatives {/,(r) by the following equation: 

(51) t*(r)U t (r)(x 3 ) = -± t *(r)dg(r)(t* (r))(^)(^), 
which implies by direct calculations with the help of (49): 

(52) jLj7(T)(i*(r))=0, 
or by continuity that 



(53) 



a(r)(t*(r))=g(f). 
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We see that the continuous family of linear transformations C(q' , r), C(q' , 0) = Id we just constructed, move 
the vector fields Vi(q') - the set of generators we have - into another set Vi(q' , t) = cf r)Vk(q') of vector 
fields such that: 

1) when V(q) is open, then for r small enough the vector fields Vk(q' , r) belong to our control set {V u (q')\u 6 
U}, 

2) the point q* = q(t*) which is the image under the chronological product Q{t*) of some point from the 
zero set now equals the chronological product G{r){t* {t)) relative to another set of generators, and is the 
image of the point t*{r) <E R N which does not belong to the zero set fi(r) of this later chronological product; 
i.e., the differential of dQ{r)(t* (r)) is the surjection on some small neighborhood of q*. 

In particular, all coordinate subspaces in R N defined by some number of equalities of the type = 
belong to the zero set ft. For instance, an arbitrary trajectory q(t),0 < t of Em which is the solution of 
q(t) = V u ( t )(q(t)), is the image of the first coordinate line {U — 0,i > 1} in R N under the chronological 
product Q(ti, ...,tiv) = Py\ ° ••• ° Py™ - if only we may consider the vector field V u ^ as the first vector field V\ 
in the construction of our chronological products. If so, then the arguments above implies that Em is involved. 
We come also to the same conclusion if trajectories with arbitrary controls u(t) have "nice" (e.g., smooth) 
dependence on u and may be approximated by trajectories with piece- wise controls; i.e., by chronological 
products. To treat the general situation we introduce one additional property. 

Definition. We say that V(q) is ample if it is open and the convex hull ofV(q) coincide with L{q). 

Now take an arbitrary trajectory q(t), < t < e under control u(t) issuing from the point q in which Em 
satisfies LARC. Since LARC implies local transitivity for e sufficiently small q(e) equals some chronological 
product Q(ti, ...,t N ). Hence, the point q is connected with q(e) by some trajectory q(t) of E M - possibly 
different from q(t) - with piece-wise control function. The part of such trajectory corresponding to the first 
non-zero tj is the solution of Em under some constant control: q — ±Vi(q(t)),0 < t < \ti\. If U is positive, 
then this part of the trajectory q(t) belongs to the positive orbit of q. If t{ is negative, and V(q) is ample, 
then Vi is the linear combination of some other control vectors 14 with positive coefficients 

(54) Vi(q) - \ k V k {q), 

and using the LARC at q it is not difficult to find a point q* on the trajectory q(t) which equals the chronological 
product Q(ti, ...,tjv) defined with the help of the new vectors and such that the first non-zero argument 
tk is positive. In both cases we obtain the trajectory going from q to q(e) such that some part of it is some 
coordinate interval with positive coordinates. Now the Lemma 4 claims that q(t) is the general trajectory 
relative to some set of generators. 

In other words, we just proved the following result. 

Lemma 5. IfV(q) is ample, then the control system Tim satisfying LARC at q is involved. 

Combining this with the claim of the Theorems I and 2 we conclude the following. 

Theorem 3. If for the system E the set of control vectors V(q) is ample at some point q, where the LARC is 
satisfied, then every closed orbit of Em going through the point q has some open neighborhood contained 
in the positive orbit + {q) of q, and another open neighborhood B~ such that for every q' E B~ the point q is 
reachable from q' . Their intersection B q is an open neighborhood of the closed trajectory on which the system 
Em is controllable. 

3. The Closed Orbit Controllability Criterium 
Now we are ready to prove our main result: 
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Theorem A. Let Em be some control dynamical system on the compact connected manifold M n . If through 
an arbitrary point p of M n goes some closed orbit p(t),0 <t<t p which is non-trivial (i.e., t p > 0) and contains 
some point q(p) where V(q(p)) is ample and the LARC is satisfied, than the system Em is controllable on 
M n . 

Proof. The proof is obvious: every such orbit has an open neighborhood B q (p) on which the system Em is 
controllable. The union of all B q {p) covers M n . Since M n is compact there exists some finite sub-covering 

(55) M n = U i= i,..., c S, i . 

Because M" is connected for two arbitrary point q and p we may find a finite sequence B Qii , B qik from the 
finite covering (55) such that q £ B qii , p e B qik and B qis n B qi i ^ 0. Take qo = q; some q s G B qis n B qi 
and qk+i = P- Since Em is controllable on each B qis there exists a trajectory from q s to q s+ i for all s = 0, k. 
Taking the composition of these trajectories we obtain the trajectory of E M going from q to p. Since q, p where 
arbitrary this proves that E M is controllable on M n . 

The Closed Orbit Controllability Criterium. Note that i/Em is controllable on M n then for an arbitrary 
point q there exists some closed trajectory of Em going through this point. Indeed, since Em is controllable 
there exists some its trajectory 7 from q to q(—e), < e for an arbitrary trajectory q(t), —00 < t < 00 passing 
through q. The composition of 7 and the interval q(t),—e < t < gives us the closed non-trivial trajectory 
of Em through q. Thus, the Theorem A above provides us with the necessary and sufficient controllability 
condition for the control systems Em on compact manifolds with ample set of control vectors and satisfying 
the LARC, which we call the closed orbit controllability criterium. 

The Theorem A works especially well when applied to control dynamical systems on surfaces, when the 
trajectory curve is also a hyper-surface; i.e., locally divides the manifold. If, for instance, M 2 is a surface 
and Em has the finite set of generator vector fields V% such that the corresponding dynamical systems E, = 
{q(t) = Vi(q(t))} are stable; i.e., have non-degenerated zeros, then our closed orbit controllability criterium 
essentially provides the complete answer to the controllability question. This answer may be given with the 
help of some diagrams (pictures) describing iterations on the space of orbits of Em, which we split into some 
number of intervals, corresponding to the cell representation of the phase portraits of Ej. We describe this 
in the forthcoming paper [CM], where we pay the particular attention to the projections of bi-linear systems 
in i? 3 to the two-dimensional unit sphere S 2 of directions in R 3 . As the example the next theorem gives the 
sufficient controllability condition for such control systems: let 

x(t) = A(u)x(t) = (A + m 1 ^ + ... + u d B d )x(t), (E) 

be the control systems of linear equations in i? 3 , where the right-hand side - the linear operator A(u) - is a 
linear combination of some constant linear operators A and Bk which do not depend on the control parameter 
u G R d . The bi-linear system E defines the control system E pr on the unit sphere S 2 in i? 3 , called the projected 
system, when we consider the evolution of unit directions of solutions x(t) of E. For each control parameter 
u being fixed the phase portrait of the corresponding projected system admits the natural cell decomposition 
into, so called Jordan cells. Then the application of our closed orbit controllability criterium provides, among 
other, the following. 

Theorem B. If for two control parameters u and v the right-hand side linear operators A(u) and A(v) have 
complex eigenvalues Xc{u) and Xc(v) correspondingly, then the system E satisfying LARC is controllable if 
for the real eigenvalues Xr(u) and Xr(v) of A(u) and A{v) it holds 



(X R (u) - Re(X c (u))) (X R (v) - Re(X c (v))) < 0. 
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We conclude with the example of the control system on the two-dimensional torus which satisfies LARC 
everywhere and satisfies our closed orbit criterium, but is not controllable since the set of control vectors is 
not "involved". 

Example 2. Let {5 1 (^),0 < <p < 27r} C R 2 be the unit circle S 1 {4>) = (cos{4>) , sin{4>)) in the two-dimensional 
(x,y) plane R 2 . Define two vector fields on this circle: V\{4>) = —sin(<f))(sin((j)),—cos((j))) which equals the 
unit tangent to S 1 vector field multiplied by the y-coordinate and has two zeros qi = (—1,0) and q<i = (1,0); 
and Vi - any smooth vector field vanishing outside \ ^-neighborhoods of qi and qi, but which is not zero at 
these points. Since these vector fields do not vanish simultaneously and S 1 is one- dimensional the control 
system q(t) = Vi(q),i = 1,2 satisfies LARC. On the other hand it is not controllable because in two point 
Pi = (0, 1) and p2 = (0, —1) set of all possible directions of trajectories going through these points is the 
unique vector (—1,0) pointing to the same direction ("to the left"); i.e., any trajectory starting from p\ or 
P2 stays in the "left" part of the circle where x < and can not reach any point with positive x- coordinate: 

g+( Pt )c{x<o}^s 1 . 

Next we multiply S 1 ((j)) by another circle S 1 ^), and denote by V3 the unit vector field tangent to this 
S 1 ^)- As the result we obtain the two-dimensional torus T 2 {4>, ip) = S 1 (<p) x S 1 ^) and the control system 
on it defined by three vector fields Vi,i — 1,2,3. Easy to see that this system 1) satisfies LARC everywhere, 
2) for an arbitrary point q there exists non- degenerated closed trajectory of the system going through this point 
- the second factor S 1 ^), 3) the system is not controllable. 
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